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DETAILED ACTION 
This is a Non Final Office Action in response to the Patent Application filed 
10/03/2005. Claims 1-24 are pending. Claims 1, 2, 12 and 21-24 are independent 
claims, which claimed priority of No. 10/406,217 dated 04/04/2003 (by Matshushita 
Electric-Japan). 

Information Disclosure Statement 

A signed and dated copy of applicant's IDS, which was filed on 05/30/2008; 
1 1/21/2007; 08/22/2008 and 10/03/2005, are attached to this Office Action. 

It is noted, a portion of the references cited in the Information Disclosure 
Statement filed 05/30/2008 fail to comply with the provisions of 37 CFR 1 .97, 1 .98 and 
MPEP § 609 because item "CA" of the reference does not list the publication date, title, 
author for the references. The examiner has not considered, and has lined through, 
that portion of the Information Disclosure Statement as to the merits (see the 
attachments strike-out line items for details). 

Applicant is advised that the date, title and author of any re-submission of any 
item of information contained in these Information Disclosure Statements or the 
submission of any missing elements will be the date, title and author of submission for 
purposes of determining compliance with the requirements based on the time of filing 
the statement, and title and author including all certification requirements for statements 
under 37 CFR 1 .97(e). See MPEP § 609.05(a). 
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Claims Rejection - 35 U.S.C. 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described 
as set forth in section 102 of this title, if the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which 
said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

Claims 1-24 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Sull et al., (US 20070033292A1 Division of No. 09/91 1 ,293 filed 07/23/2001 ) 
[hereinafter "Sull"], in view of Yamato etal., (US 20020104101A1 filed 01/31/2002) 
[hereinafter "Yamato"]. 

Regarding independent claim Sull teaches: 

A content-related information delivery system including: a playback 
apparatus. 

(at Page 6 Paragraph [0047]^Sull discloses this limitation in that the multimedia 
content can be facilitating, creating, storing, indexing, searching, retrieving and 
rendering on any device [set-top box (STB), apparatus], wherein the multimedia content 
can be one or more frames of video, audio data, text data such as a string of 
characters, or any combination or permutation thereof.) 

comprising: a monitoring unit operable to monitor a current playback 
position of a content during playback, a playback position information 
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generating unit operable to acquire the current playback position from the 
monitoring unit, 

(At Fig. 9 and Para [0198]->Sull discloses this limitation in that a monitoring unit [i.e., 
Multimedia content presentation positional item 906 of Fig. 9] operable to monitor a 
current playback position of content during playback). 
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In addition, Sull does not expressly teach but Yamato teaches: 

a playback positioning information transmitting unit operable to 
transmit the generated playback position information to a server, 

(At Fig. 14 and at Page 16 Paragraph [021 5^021 6]^Yamato discloses this limitation 
that is during subsequent playback of the program at S171 the designate reference 
information [i.e., a play back position] is transmitted at S173 to the server item 30. This 
is generally set forth at Fig. 14- S171-S173 and at Paragraphs [0215->0216] of 
Yamato. Also See Example 12 at Para [0220], Ymato discloses the Recording a 
Program on a Terminal Apparatus and then, During Subsequent Playback of the 
Program, Linking Program-Relevant Information to a Specific Element that is displayed 
in a Scene in the Program and Registering in a Server. 
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the server comprising: 

a playback position information receiving unit operable to receive 
the playback position information from the playback apparatus, a related 
information acquiring unit operable to acquire information related to the 
segment of the content specified by the received playback position 
information, 

(At Fig. 14 and at Page 16 Paragraph [021 5->021 6]->Yamato discloses this limitation 
that is during subsequent playback of the program at S171 the designate reference 
information [i.e., a play back position] is transmitted at S173 to the server item 30. This 
is generally set forth at Fig. 14 S171-S173 and at Paragraphs [0215->0216] ofYamato. 
Also See Example 12 at Para [0220], Ymato discloses the Recording a Program on a 
Terminal Apparatus and then, During Subsequent Playback of the Program, Linking 
Program-Relevant Information to a Specific Element that is displayed in a Scene in the 
Program and Registering in a Server.) 

A related information transmitting unit operable to transmit the 
acquired related information to a destination apparatus. 

(At the Abstract ->Yamato discloses this limitation in that an information transmission 
source that transmits media information by way of mass media; a server that stores 
content information linked to media information; and a terminal apparatus to which 
content information stored in the server is delivered to the terminal apparatus.) 
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Accordingly, It would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify Sull' a method and apparatus for facilitate the creating, 
storing, indexing, searching, retrieving and rendering of multimedia content on any 
device [set-top box (STB)] capable wherein the multimedia content can be one or more 
frames of video, audio data, text data such as a string of characters, or any combination 
or permutation thereof, to include a means of said the server comprising a playback 
position information receiving unit operable to receive the playback position information 
from the playback apparatus, a related information acquiring unit operable to acquire 
information related to the segment of the content specified by the received playback 
position information, a related information transmitting unit operable to transmit the 
acquired related information to a destination apparatus as taught by Yamato, because 
they are both from the analogous art of facilitate the creating, storing, indexing, 
searching, retrieving and rendering of multimedia content between terminal apparatus 
[i.e. STB] and server. Therefore, the artisan would have well appreciated that Yamato 
relates to general method and apparatus for transmitted from terminal apparatus by way 
of Internet is received by receiver of server and transmitting back to the playback 
terminal the specified content in Sull; this is done in an iterative manner to provide an 
information that both enables extensive collection of relevant information that relates to 
media information that is transmitted by mass media and that uses the provision of 
media information to provide users with this relevant information that relates to media 
information that is transmitted by mass media and that uses the provision of media 
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information to provide users with this relevant information. This is generally set forth at 
Page 2 Para [0018-0019] of Yamato. 



Regarding independent claim 2, 

Claim 2 recites a playback apparatus configured to perform the method of 
claim 1 . Thus, Sull and Yamato disclose every limitation of Claim 2 and provide 
proper reasons to combine, as indicated in the above rejection for Claim 1 - Also 
see Sull at Para [0047], discloses retrieving and rendering of multimedia content 
on any device [set-top box (STB), apparatus], wherein the multimedia content 
can be one or more frames of video, audio data, text data such as a string of 
characters, or any combination or permutation thereof. 



Regarding independent claim 12, 

Claim 12 recites a server configured to perform the method of claim 1 . 
Thus, Sull and Yamato disclose every limitation of Claim 12 and provide proper 
reasons to combine, as indicated in the above rejection for Claim 1 . 



Regarding independent claim 21, 

Claim 21 is fully incorporated similar subject of claim 1 cited above. Thus, 
Sull and Yamato disclose every limitation of Claim 21 and provide proper 
reasons to combine, as indicated in the above rejection for Claim 1 . 
In addition, Sull teaches: 
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Playback position information acquiring step of generating playback 
position information showing a segment of the content; 

(At the Abstract ->Sull discloses this limitation in that the multimedia bookmark 
facilitates the searching of portions or segments of multimedia files, particularly when 
used in conjunction with a search engine. Also Sull further discloses a monitoring unit 
[i.e., Multimedia content presentation positional item 906 of Fig. 9] operable to monitor a 
current playback position of a content during playback, see Fig. 9 and Para [0198].) 

Regarding independent claim 22, 

Claim 22 recites a content related information request program executable 
by a playback apparatus configured to perform the method of claim 1 . Thus, Sull 
and Yamato disclose every limitation of Claim 22 and provide proper reasons to 
combine, as indicated in the above rejection for Claim 1 - Also see Sull at Para 
[0016], described the set-top box (STB) is the personal video recording (PVR) 
contains digital video encoder/decoder based on an international digital video 
compression standard such as MPEG-1/2. 

Regarding independent claims 23 and 24, 

Claims 23 and 24 are fully incorporated similar subject of claims 1 and 21 
cited above. Thus, Sull and Yamato disclose every limitation of Claims 23 and 24 
and provide proper reasons to combine, as indicated in the above rejection for 
Claims 1 and 21. 
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Claim 2, 

Sull and Yamato teach the method of claim 2 and further comprise: 

A playback position information generating unit operable to 
generate playback position information specifying a segment of the 
content; 

(At the Abstract -»Sull discloses this limitation in that the multimedia bookmark 
facilitates the searching of portions or segments of multimedia files, particularly when 
used in conjunction with a search engine. 

Also see Fig. 9 and Para [0198] ->Sull discloses this limitation in that a 
monitoring unit [i.e., Multimedia content presentation positional item 906 of Fig. 9] 
operable to monitor a current playback position of content during playback). 

In addition, Sull does not expressly teach but Yamato teaches: 

And a playback position information transmitting unit operable 
to transmit the generated playback position information to the 
server. 

(At Fig. 14 and at Page 16 Paragraph [0215^0216] Yamato discloses this limitation 
that is during subsequent playback of the program at S171 the designate reference 
information [i.e., a play back position] is transmitted at S173 to the server item 30. This 
is generally set forth at Fig. 14 S171-S173 and at Paragraphs [0215->0216] of Yamato. 
Also See Example 12 at Para [0220], Ymato discloses the Recording a Program on a 
Terminal Apparatus and then, During Subsequent Playback of the Program, Linking 
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Program-Relevant Information to a Specific Element that is displayed in a Scene in the 
Program and Registering in a Server.) 

Accordingly, It would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify Sull' a method and apparatus for facilitate the creating, 
storing, indexing, searching, retrieving and rendering of multimedia content on any 
device [set-top box (STB)] capable wherein the multimedia content can be one or more 
frames of video, audio data, text data such as a string of characters, or any combination 
or permutation thereof, to include a means of said a playback position information 
transmitting unit operable to transmit the generated playback position information to the 
serve as taught by Yamato, because they are both from the analogous art of facilitate 
the creating, storing, indexing, searching, retrieving and rendering of multimedia content 
between terminal apparatus [i.e. STB] and server. Therefore, the artisan would have 
well appreciated that Yamato relates to general method and apparatus for transmitted 
from terminal apparatus by way of Internet is received by receiver of server and 
transmitting back to the playback terminal the specified content in Sull; this is done in an 
iterative manner to provide an information that both enables extensive collection of 
relevant information that relates to media information that is transmitted by mass media 
and that uses the provision of media information to provide users with this relevant 
information that relates to media information that is transmitted by mass media and that 
uses the provision of media information to provide users with this relevant information. 
This is generally set forth at Page 2 Para [0018-0019] of Yamato. 
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Claim 3, 

Sull and Yamato teach the method of claim 2 and further comprise: 

a selecting subunit operable to receive a user selection of a 
desired scene of the content; an acquiring subunit operable to 
acquire a playback position of the selected scene of the content; and 
a generating subunit operable to generate the playback position 
information that includes the acquired playback position; 
(At Fig. 6 and Para [0164] ->Sull discloses this limitation in that the multimedia 
bookmark is generating metadata for several variations of a multimedia content. For 
example, in the case of video content, the segment may be a single frame, a single shot 
consisting of successive frames, or a group of several successive shots.) 

Claim 4, 

Sull and Yamato teach the method of claim 3 and further comprise: 

A monitoring unit operable to monitor a current playback 
position of the content during playback, wherein the acquiring 
subunit acquires the playback position of the selected scene from 
the monitoring unit; 
(At Fig. 9 and Para [0198]->Sull discloses this limitation in that the a monitoring unit 
[i.e., Multimedia content presentation positional item 906 of Fig. 9] operable to monitor a 
current playback position of a content during playback and item 928 shows the sub units 
of 912.) 
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Claim 5, 

Sull and Yamato teach the method of claim 4 and further comprise: 

content identifier acquiring unit operable to acquire a content 
identifier uniquely identifying the content, wherein the monitoring 
unit monitors the current playback position by measuring a time 
period elapsed from a start of the playback, and the generating 
subunit generates the playback position information that includes 
the content identifier acquired by the content identifier acquiring unit 
and the playback position acquired by the acquiring subunit; 
(At Fig. 9 and Para [0198]->Sull discloses this limitation in that the a monitoring unit 
[i.e., Multimedia content presentation positional item 906 of Fig. 9] operable to monitor a 
current playback position of a content during playback and item 928 shows the sub units 
of 91 2. Also Sull further discloses each segment may be described by some elementary 
semantic information using texts. The segment is referenced by the metadata using 
media locators such as frame number or time codes- See Sull at Para [001 7].) 

Claim 6, 

Sull and Yamato teach the method of claim 5 and further comprise: 

a display unit operable to display the content on a screen; and 
an on-screen position acquiring unit operable to receive a user 
selection of a desired point on the screen displaying the selected 
scene and acquire an on-screen position of the selected point, 
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wherein the generating subunit generates the playback position 
information that includes the content identifier, the playback 
position, and the on-screen position; 

(At Fig. 9 and Para [0198]->Sull discloses this limitation in that the a monitoring unit 
[i.e., Multimedia content presentation positional item 906 of Fig. 9] operable to monitor a 
current playback position of a content during playback and item 928 shows the sub units 
of 912. Also Sull further discloses each segment may be described by some elementary 
semantic information using texts. The segment is referenced by the metadata using 
media locators such as frame number or time codes- See Sull at Para [0017].) 



Claim 7, 

Sull and Yamato teach the method of claim 4 and further comprise: 

Wherein the playback apparatus reads the content from a 
portable recording medium and plays back the read content he 
monitoring unit monitors the current playback position on the 
recording medium during playback of the content, and the acquiring 
subunit acquires the playback position of the selected scene on the 
recording medium. 

(at Page 6 Paragraph [0047]->Sull discloses this limitation in the multimedia content 
can be facilitating, creating, storing, indexing, searching, retrieving and rendering on any 
device [set-top box (STB), wherein the multimedia content can be one or more frames 
of video, audio data, text data such as a string of characters, or any combination or 
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permutation thereof. Also Sull further described one of the features provided by the 
recent set-top box (STB) is the personal video recording (PVR) that allows simultaneous 
recording and playback [recording medium]. 

Claim 8, 

Sull and Yamato teach the method of claim 3 and further comprise: 

wherein the content is composed of a plurality of frames, each 
frame includes a playback time showing a time from a start of the 
content at which the frame is to be played back, and the acquiring 
subunit acquires a playback time of a frame corresponding to the 
selected scene; 

(At Fig. 9 and Para [0198]->Sull discloses this limitation in that the a monitoring unit 
[i.e., Multimedia content presentation positional item 906 of Fig. 9] operable to monitor a 
current playback position of a content during playback and item 928 shows the sub units 
of 912. Also Sull further discloses each segment may be described by some elementary 
semantic information using texts. The segment is referenced by the metadata using 
media locators such as frame number or time codes- See Sull at Para [001 7].) 

Claim 9, 

Sull and Yamato teach the method of claim 2 and further comprise: 

Wherein the content is composed of a plurality of frames, the 
selecting subunit acquires a frame corresponding to the selected 
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scene, and the generating sub-unit generates the playback position 
information that includes the acquired frame; 

(At Fig. 9 and Para [0198]->Sull discloses this limitation in that the a monitoring unit 
[i.e., Multimedia content presentation positional item 906 of Fig. 9] operable to monitor a 
current playback position of a content during playback and item 928 shows the sub units 
of 912. Also Sull further discloses each segment may be described by some elementary 
semantic information using texts. The segment is referenced by the metadata using 
media locators such as frame number or time codes- See Sull at Para [0017].) 

Claim 10, 

Sull and Yamato teach the method of claim 2 and further comprise: 

A related information receiving unit operable to receive from 
the server, information related to the segment of the content 
specified by the playback position information; 

(At Para [0047]->Sull discloses this limitation in that the multimedia content can be 
facilitating, creating, storing, indexing, searching, retrieving and rendering on any device 
[set-top box (STB), wherein the multimedia content can be one or more frames of video, 
audio data, text data such as a string of characters, or any combination or permutation 
thereof. Also Sull further discloses the positional and content information to be included 
in the multimedia bookmark may be readily obtained from the video's source. However, 
to obtain the desired metadata, the multimedia bookmark process 5206 preferably 
accesses network 5202 via two-way communication medium 5204 to thereby establish 
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a communication link with metadata server 5210, This is generally set forth at Para 
[0318] ofSull.) 

Claim 11, 

Sull and Yamato teach the method of claim 10 and further comprise: 

The playback apparatus playback the content in association 
with the related information received by the related information 
receiving unit; 

(At Para [0047]->Sull discloses this limitation in that the multimedia content can be 
facilitating, creating, storing, indexing, searching, retrieving and rendering on any device 
[set-top box (STB), wherein the multimedia content can be one or more frames of video, 
audio data, text data such as a string of characters, or any combination or permutation 
thereof. 

Also at Fig. 9 and Para [0198] ->Sull discloses a monitoring unit [i.e., Multimedia 
content presentation positional item 906 of Fig. 9] operable to monitor a current 
playback position of content during playback. Also Sull further discloses each segment 
may be described by some elementary semantic information using texts. The segment 
is referenced by the metadata using media locators such as frame number or time 
codes- See Sull at Para [0017].) 

Claim 13, 

Sull and Yamato teach the method of claim 12 and further comprise: 
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Claim 13 is fully incorporated similar subject of claim 1 cited above. Thus, 
Thus, Sull and Yamato disclose every limitation of Claim 13 and provide proper 
reasons to combine, as indicated in the above rejection for Claim 1 . 
In addition, Sull teaches: 

A related information storage unit operable to store, for each scene 
of the content, information related to the scene in association with a 
playback position of the scene, at the server, 
(Sull further discloses a set top box ("STB") with the personal video recorder ("PVR") 
functionality. In this embodiment 6800 of the present invention, the metadata agent 
6806 receives metadata for the video content of interest from a remote metadata server 
6802 via the network 6804; this is generally set forth at Para [0320] of Sull. 

See also at Page 7 Para [0064] -> Page 8 Par [0074] -»Sull discloses this 
limitation in that editing a multimedia file by providing a metafile, the metafile having at 
least one segment that is selectable and recordable, the recording can be applied not 
only to videos stored on CD-ROM, DVD and hard disk but also to streaming videos over 
a network.) 

Claim 14, 

Sull and Yamato teach the method of claim 13 and further comprise: 

The related information storage unit stores, for each scene of the 
content, the related information which is a frame corresponding to the 
scene or information generated by processing the frame. 
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(At Page 7 Para [0064] -» Page 8 Par [0074] ->Sull discloses this limitation in that 
editing a multimedia file by providing a metafile, the metafile having at least one 
segment [i.e., frame] that is selectable and recordable, the recording can be applied not 
only to videos stored on CD-ROM, DVD and hard disk but also to streaming videos over 
a network. Also Sull further discloses each segment may be described by some 
elementary semantic information using texts. The segment is referenced by the 
metadata using media locators such as frame number or time codes- See Sull at Para 
[0017].) 

Claim 15, 

Sull and Yamato teach the method of claim 13 and further comprise: 

The related information storage unit stores, for each scene of the 
content, the related information which is a frame corresponding to the 
scene or information generated by processing the frame. 

(At Page 7 Para [0064] -> Page 8 Par [0074] -»Sull discloses this limitation in that 
editing a multimedia file by providing a metafile, the metafile having at least one 
segment [i.e., frame] that is selectable and recordable, the recording can be applied not 
only to videos stored on CD-ROM, DVD and hard disk but also to streaming videos over 
a network. Also Sull further discloses each segment may be described by some 
elementary semantic information using texts. The segment is referenced by the 
metadata using media locators such as frame number or time codes- See Sull at Para 
[0017].) 
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Claim 16, 

Claim 16 recites a destination storage unit operable to perform the method 
of claims 1 and 12. Thus, Sull and Yamato disclose every limitation of Claim 12 
and provide proper reasons to combine, as indicated in the above rejection for 
Claim 1. 

In addition, Sull teaches: 

a user identifier receiving unit operable to receive from the 
playback apparatus a user identifier uniquely identifying a user of the 
playback apparatus; and a destination storage unit operable to store a 
plurality of user identifier each in association with a destination with a 
peace of information showing a destination apparatus for transmission of 
the related information, 
(At Para [0316] ->Sull discloses this limitation in that the bookmarks are captured from 
sports programs, science function programs, and comedy programs. As the 
recommendation engine 5004 examines the "genre" attribute contained in the metadata 
of each multimedia bookmark wherein over time and as the user saves additional 
multimedia bookmarks, the recommendation engine 5004 is better able to identify the 
user's viewing preferences. As a result, whenever the user wishes to view a program, 
The recommendation engine can use its predictive capabilities to serve as a 
Guide to the user through a multitude of program channels by automatically 
bringing together the user's preferred programs. The recommendation engine 
5004 may also be configured to perform similar analyses on such metadata 
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information as the "actors," "title," etc.) 
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Claim 17, 

Claim 17 is fully incorporated similar subject of claims 1 and 16 cited 
above. Thus, Sull and Yamato disclose every limitation of Claim 17 and provide 
proper reasons to combine, as indicated in the above rejection for Claim 1 . 

Claim 18, 

Claim 18 is fully incorporated similar subject of claims 1 and 16 cited 
above. Thus, Sull and Yamato disclose every limitation of Claim 17 and provide 
proper reasons to combine, as indicated in the above rejection for Claim 1 . 
In addition, Sull teaches: 

An apparatus other than the playback apparatus, 
(At the Abstract^Sull discloses this limitation in that the bookmarks to multimedia files, 
such as movies, and audio files, such as music facilitate the searching of portions or 
segments of multimedia files, particularly when used in conjunction with a search 
engine. Additional methods are provided that reformat a video image for use on a 
variety of devices that have a wide range of resolutions [i.e., other than the playback 
apparatus.] 
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Claim 19, 

Sull and Yamato teach the method of claim 16 and further comprise: 

Billing unit operable to charge the user for the related information, 
based on the user identifier. 

(At Para [0325] -> Sull discloses this limitation in that the content providers can charge 
consumers at the nominal cost for metadata download.) 

Claim 20, 

Sull and Yamato teach the method of claim 10 and further comprise: 

Wherein the playback position information receiving unit receives, as 
the playback position information, a frame out of a plurality of frames 
constituting the content, and the related information acquiring unit 
generates the related information by processing the received frame. 
(At Para [0031] -> Sull discloses this limitation in that the Metadata of a video segment 
contain image information such as the key frame [i.e. a frame out of the frames] of a 
segment.) 

It is noted that any citations to specific, pages, columns, lines, or figures in the 
prior art references and any interpretation of the references should not be considered to 
be limiting in any way. A reference is relevant for all it contains and may be relied upon 
for all that it would have reasonably suggested to one having ordinary skill in the art. 
See, MPEP2123. 
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Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Quoc A. Tran whose telephone number is 571-272- 
8664. The examiner can normally be reached on Mon through Fri 8AM - 5PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Doug Hutton can be reached on (571)272-4137. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 

Patent Application Information Retrieval (PAIR) system. Status information for 

published applications may be obtained from either Private PAIR or Public PAIR. 

Status information for unpublished applications is available through Private PAIR only. 

For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 

you have questions on access to the Private PAIR system, contact the Electronic 

Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 

USPTO Customer Service Representative or access to the automated information 

system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Quoc A. Tran/ 
Examiner, Art Unit 2176 

I (Doug Hutton/ 
Doug Hutton 
Supervisory Primary Examiner 
Technology Center 2100 



